Ajnd/r^ a ;~/ 


NASA Contractor Report 170411 


NASA-CR- 17041 1 
19840016525 


Optimal Cooperative Control Synthesis 
Applied to a Control-Configured Aircraft 


D. K. Schmidt and ML Innocenti 


Grant NAG4-1 
January 1984 



NF02564 


NBHARY CORY 

5 I 1934 

LANGLEY RESEARCH CENTER 
LIBRARY, NASA 
HAMPTON, VIRGINIA 


r\JASA 

National Aeronautics and 
Space Administration 



NASA Contractor Report 170411 


Optimal Cooperative Control Synthesis 
Applied to a Control-Configured Aircraft 

D. K. Schmidt and M. Innocenti 

School of Aeronautics and Astronautics, Purdue University, W. Lafayette, Indiana 47907 


Prepared for 
Ames Research Center 
Dryden Flight Research Facility 
under Grant NAG4-1 

1984 


NASA 

National Aeronautics and 
Space Administration 
Ames Research Center 
Dryden Flight Research Facility 
Edwards, California 93523 


/ I&rf- 1 <o3H*P* 





This Page Intentionally Left Blank 



1 


I. INTRODUCTION 

Quantitative handling qualities specifications are almost non 
existent for flight vehicles exhibiting non conventional dynamic charac- 
teristics. Examples include vehicles in completely foreign operating 
environments, or radically new aerodynamic and flight control designs 
such as Control Configured Vehicles (CCV's). Furthermore, higher order- 
system dynamics or even augmentation itself, have been found to signifi- 
cantly alter pilot opinion ratings so that the existing handling 
qualities specifications, based on conventional modes, are not appropriate 
for use with such systems. 

A methodology that would effectively take into account both aug- 
mentation system design and the human evaluation in a single analytical 
framework was proposed in Reference [1]. Optimal control theory was 
used to synthesize the augmentation control law as well as to model 
the human pilot control input. More recently, the methodology was 
extended to include a more complete pilot model and the restriction 
that the augmentation is a linear combination of selected system 
measurements [2]. 

The aim of the present paper is to apply the extended approach to 
the synthesis of an augmentation system, consisting of a control law 
of simple structure, for a control -confi gured flight vehicle similar 
to the AFTI/F-16 [3], and to compare the resulting controller with two 
alternate control designs - a rate command system and a simplified, 
linearized version of this AFTI/F-16 air-to-air combat mode control 
law. 
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II. METHODOLOGY REVIEW 

At this point, a brief review of the methodology is appropriate - 
the complete derivation can be found in Reference [4]. 

The aircraft dynamics, linearized about a steady state level flight 
condition is expressed by the following linear time invariant system 


x = Ax + BO + B fl u fl + Dw (1 ) 

P p A A 

wi th xeR n , 0 and u* eR m . The vector w is a zero-mean Gaussian white- 
P H 

noise process with intensity W. In addition to (1), we assume that 

measurements or outputs available to the two "controllers" u and u n 

p A 

are 



respecti vely. The vector v p is also a zero-mean Gaussian white-noise 
process (with intensity Vp) representing the error in the pilot's 
observation, and y^ are the measurements for feedback augmentation. 

A schematic diagram of the aircraft plus control dynamics is shown 
in Figure 1. 

The input Up represents the human operator component of the 
total control vector u, or for example, control surface deflections 


associated with the pilot's stick input. The mathematical model for 
the pilot has been chosen to be similar to the optimal control model 
of Kleinman and others [5], The input u^, associated with the aug- 
mentation system, is constrained here to be the direct feedback of 
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Figure 1 LOCR Block Diagram 
measured outputs, or 

°A = G ^A 

(Note that this is consistent with the desire for simple, easy to 
implement control laws). 
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where £{•} indicates the expected value operator, and the weighting 
matrices are Q >_ 0, R-j >_ 0, R 2 > 0. Since the pilot controls the 
augmented aircraft, the minimizing control policy for u p must be found 
subject to the dynamic constraint 

x = (A + B a GC x ) x + (B p + B A GC u )G p + Dw (5) 

where G is the matrix of augmentation gains yet to be found. Now 
-T -T 

defining x = [x '« u ] the pilot's optimal control input is given by 

P 


Up " Kx 


K = -Rj" 1 [0 : I]P 
where x is the best estimate of x obtained from the Kalman filter 


( 6 ) 


Up + M[y p - (C p ; 0} x] 


A+B A GC x 

B + B.GC 
p A u 

- - . 

x + 

0 

o 

o 


I 


(7) 


M = sCp^p ' 1 


Finally, P and z are obtained from their respective Ricatti equations 

T 


1 A+B A GC x ! B p +B A GC u 


P + P 


L 


a + b A Gc x « B p +B A GC U 
0 0 



q ; o 

1 0 

+ 

i 

- p — 

; 

0 ! R-j 

1 I 


R 2 _1 [0 / I] P = 0 


( 8 ) 


and 
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A+B A GC x 


V B A GC u 


E + E 


fl+ ¥ c x ;■ b p +b a gc u 
0 0 


+ 


| dwd t 

l 

o 


VI 

1 

1 

I 

8 O 

1 

J 

r v 

-E 

0 


V 1 [c p : £ " 0 


Now, consistent with the human operator model [5] the control input 
is modified to the (sub-optimal) relation 

Op* * Kx + v m 
or 


or for scalar 




u = K x + K u + v 
p x u p m 


. * 
T U 

n p 


9 X - u p + v m 


(9) 


where t is the human's neuromuscular lag time constant and v is 
n 3 m 

a zero-mean Gaussian white-noise process with intensity V m that 
represents the error contaminating the pilot's commanded control. 


Solution for u, 


For the input u^, we wish to find the controller u^ (or gain G) 
as in (3) that minimizes the index of performance that includes J or 

r 


1 


J A = J + ^ 1rn T U A Fu A 

' ' " J -*>0 J ~ 


- T,- 


(10) 


subject to the constraints of Equations (5) and (7). Thus , the 
augmentation is chosen to be "pilot-optimal" in the sense that its 
index of performance J A incorporates Jp , which, as in [6], [7], and [8], 
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is taken to be correlated with the pilot rating. 

Now in solving for u^, we must include the dynamics of the 

(pilot's) state estimator, Eqn. 7, in addition to the plant dynamics, 

Eqn. 5. Substituting Eqn. 9 into the above two relations, and defin- 

D °r 

ing the augmented state vector q = Cx ‘ ; X ] > we may write the system 
dynamics in the form 

q = Aq + §u A + Dw (11) 

with 

W T = [w T vj yj] ; E[w(t)wla)]= W<$ (t-a) 


A 


A 

0 


B !. 0 

P ; 


MC 


0 | A+B.GC -MC 

, A x p 

I 

0 I K.. 


0 

K. 


B +B,GC 
p A u 


b t = [B A T ! 0 ; • • • ’• 0] 



D 

0 

o. 


1 

1 

O I 

1 

I 

1 

0 


1 

1 

1 o 

i 

0 



0 



We may now express the objective function J A as 

rT 


J = E { 1 i m j 

rt T-xx. 1 


(q T Qq + u A T Fu A )dt> 


( 12 ) 


where 
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Q 0 0 



0 


0 


R 1 0 
0 k t r 2 k 


With the control law taken as 

= G = G[C A | 0]q 

the set of gains G that minimizes Eqn. 12, subject to Eqn. 11 may be 
shown to be [2] 


G = -F" 1 {B T HLC T + B T HLC T } [CLC 1 ]" 1 
where B T = [bJ 0] C = [C A 0] 

B T = [o : o : B l : o] c = [o : c A ] 


with L = E{ q q T } satisfying the relation 

[A + BG(C A 0)]L + l[a+bg(c a 0)] T 
+ DfJD T = 0 


and H satisfying 

[A+BG(C A ; 0)] T H + H[A+BG(C a ^ 0)] 


+ Q + 

C a T G T FGC a ; 

0 


0 

0 


— 




(13) 


04 ) 
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III. APPLICATION 

In the following, we will apply the technique to the augmentation 
synthesis of a CCV vehicle similar to the AFTI/F-16 aircraft [3]. 

We will sepcifically have as the design objective that of optimizing 
pitch tracking performance. The vehicle state vector is taken as 
x^ T = [u, a, 8, e] the perturbation forward velocity, angle of attack, 

T 

pitch rate, and pitch attitude angle. The control vector is u = [<5p, <5pJ, 
where 5p is the elevator and Sp the direct-lift flap deflection. (Note 
that in the following, the forward velocity u is nondimensionalized with 
the reference velocity U Q and all the angular displacements and angular 
rates will have units of degrees and degrees per second respectively). 

The motion of the aircraft is referenced to the steady-state level 
flight condition given in Table 1. 


Table 1 Flight Condition Specifications 


MACH 

M = 0.8 

Altitude 

h = 23000 ft 

Trim Velocity 

U Q = 819.57 ft/sec 

Trim angle of attack 

a = 2.345 deg 
o 3 

Load factor 

1.0 g 


The attitude "command" signal to be tracked 9 is chosen consistent 

L* 

with previous pitch tracking studies [9] and is generated by a white- 

2 

noise process m with zero mean and intensity a , passed through a 

C Cl) 

c 

second order filter having a break frequency .5 rad/sec and a 
damping ratio of 0.5. In state variable form 
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9 c 

1 0 

1 . 

+ 

0 . 

e 'c 

[_-. 25 

- . 5_ 

c 

1 . 


A x + 
c c 


D c“c 


(15) 


2 2 2 

The covariance a is chosen in this case to yield a = 10. deg . 

“c 9 c 

The information perceived by the pilot, or his observation vector 

y is chosen to be 
J P 

e 
8 

^ = e 
e 


= c X + V n » c = e - 9 (16) 

p p u ' 


representative of a pursuit tracking task. Also the pilot's objective 
function for the pitch tracking task is taken as 


J D = E { 1 i m i 
p T-x» 1 


[16(e c -e) 2 + (e c -e) 


+ r 


• 2 -, 

U P ] 


dt} 


(17) 


This selection of weightings has been shown [9], [10] to be consistent 
with experiment data on the modeled task for a wide variety of system 
dynamics. Likewise, the augmentation system objective function is 

1 - T - 

J A = Jp + EOim j u^ Fu A dt} (18) 

T-h» i o 

with F = pi > 0 the augmentation weighting matrix (I = identity). 

Now in Eqn. 17, as with the complete pilot model [5] the parameter 
r is adjusted to produce a pilot's neuromuscular lag time constant 
(Eqn. 9) t n = 0.1 seconds. 
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The measurements selected in this analysis for augmentation feed- 

_ T 

back were simply y^ = [a, e, e], or we are performing the optimization 
assuming the control law 

= G a + G« 0 + G 9 
a 0 9 

(It should be noted that the augmentation measurements in this case do 
not include pilot control input, although this is admissible in the 
formulation. Finally, in this exploratory investigation a constant 
set of stick gains were selected, and the pilot control input was taken 
as 



u p ~ Stick 


# 

6 e 


K E ^ 

St 

■J 

l s f_ 

pilot 

k f 

_ st_ 


Stick 


with K c =1.0 and K r = 0.25. Further studies will address the pos- 

St St 

sibilities of letting the stick gains be free to be selected in the 
optimization, and whether to include pilot control input in the augmen- 
tation measurements). 

Finally, the knowledge of the (observation and motor) noise 
intensities is required (or and V^). The complete pilot model [5] 
is developed on the basis of nearly constant noise to signal rati os , 
rather than constant noise intensities. Therefore, an iterative pro- 
cedure was used, beginning with the augmentation synthesis with assumed 
V m and V , then the augmented system dynamics were evaluated with the 
complete pilot model (with time delays and attention sharing) to verify 

that the covariances (V and V ) utilized were consistent with a properly 

m y 

calibrated pilot model. 
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The synthesis procedure was performed in a parametric fashion by 
varying the scalar p in (18), or control energy weighting. In this 
way, effects of different levels of augmentation authority on system 
performance can be determined. Table 2 reveals the parametric optimi- 
zation results, obtained from evaluations of the augmented aircraft 
with the complete pilot model. The augmentation control gains are 
listed in Table 3. Finally the eigenvalue locus with increasing 
augmentation level (p) is shown in Figure 2. (Time responses are 
shown in the next section of the paper.) 


Table 2 

Optimization Results 


p 

r 

Jp(cost) 

t n 

a £ (deg) 

0 . (^£) 
u 'sec' 
P 

5.0 

.025 

11.6 

0.08 

0.68 

8.26 

1.0 

.025 

11.9 

0.10 

0.68 

9.08 

0.5 

.02 

12.0 

0.10 

0.68 

10.48 

0.1 

.01 

13.3 

0.10 

0.70 

16.00 


A significant result lies in the fact that there appears to be a 
minimum value of J for the control authority level associated with the 

r 

control energy weighting of p = 1*5, rather than a monotonic reduction 
with increasing augmentation level (decreasing p ). This would in fact 
be the case if the cost weighting r and the covariance matrix W remained 
constant for each case. However, to maintain a pilot control loop 
(u ) consistent with the optimal control pilot model for each solution, 

r 

r varies to obtain a =\l sec, and W is adjusted to maintain the 
appropriate noise to signal ratios. Finally, adding the motor noise v^ to 






12 


TABLE 3 Augmentation Gains with p 


p 


a(deg) 

0(deg/sec) 

9 (deg) 

i.O 

5 e 

-.148 

.429 

.087 


6 f 

-.032 

.103 

.020 

.0 

6 e 

00 

o 

CVS 

.777 

.211 


6 f 

-.042 

.185 

.050 

.5 

5 e 

-.130 

.939 

.245 


6 f 

-.190 

.209 

.057 

.1 

6 e 

.236 

1.218 

.424 



.043 

.267 

.101 






FlfiFNVAl UE LOCUS 


- 20 . 


( N 

V. J OPEN-LOOP 

O LOW AUTHORITY p = 5. 

A MID-DESIGN f = A 
| | HIGH AUTHORITY p “ ° J 


* 3, Imag (jw) 

(rad/sec) 

• 2 * 



Real (O') (1/sec) 


Figure 2 
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the pilot's input (in Eqn. 9) results in a sub-optimal pilot-model 
solution for u . Further, these effects appear to become significant 
at higher augmentation levels of authority. 

As a result, for this chosen control law the optimization suggests 
a candidate design corresponding to a value of p near 1.0. We will 
evaluate this system further. 

IV. CONTROL SYSTEMS EVALUATION 

In an attempt toevaluate results from the proposed methodology, two 
alternate augmentation synthesis methods are chosen for comparison with 
our simple output feedback control law. They are an optimal pitch-rate 
command augmentation system, and a linearized air-to-air combat mode 
augmentation, similar to the standard air-to-air mode on the AFTI/F-16 
aircraft [3]. 

A rate command control system is chosen because it is considered 
to be very effective in attitude tracking. Briefly, it consists of an 
augmentation system that is designed to minimize the error between 
the aircraft pitch rate and the pilot's stick input, which is taken as 
the commanded pitch rate from the pilot. The synthesis of the control- 
ler used here is summarized in the Appendix. 

In addition, an augmentation system similar to the air-to-air 
standard normal mode present in the AFTI/F-16 aircraft is simplified 
and linearized about the steady state level flight condition of Table 
1. This mode is also intended to provide precise tracking capabilities. 
The characteristics of these two controllers are listed in Tables 4 and 5. 
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Table 4 

Rate Coimiand Control Law 


Veh. Dynamics x = Ax + B 


Control Law: 



G x + G 
x u 


5 stick 


* 

Gains 



a_ 

e_ 

0_ 

5 stick 


.330 

.942 

.028 

-.746 

o-O 

.073 

.232 

.007 

-.187 


*A11 angles in degrees, u non-dimensional ized with U q 


Table 6 Performance Comparison 


CONFIGURATION 

RMS ERROR (deg) 

e 

RMS STICK RATE (deg/sec) 
4 P 

Cand. Design 

.68 

9,08 

Rate Command 

.69 

15.69 

Ai r-to-Ai r Mode 

.69 

24.02 (lb/sec)* 


*This system developed for pilot input in force. 
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Table 5 

Ai r-to-Ai r Control Law 
Veh. Dynamics: x = Ax + Bu^ 

=A = "V ’ L| + Mx + N6 st 

Control Law: 

L F_ 

1 = F5 + Gx + H6 S ^ 


"l. 

0. 

.1056] , 

M = [.0007 

.5076 

2.336 0." 

.0. 

0. 

-1. . 

o. 

0. 

0. o._ 



0 . 

0 . 

7.66 

0 . 

0 . 

7.67 

0 . 

0 . 

0 . 


0. , H = -2.685 

0. -3.066 

0. J L .24 


(Note: All angles 
in degrees, stick 
input in pounds). 


The aircraft dynamics will now be compared in terms of tracking 
errors and stick rates, eigenvalues and eigenvectors, time responses, 
and predicted pilot rating. 

Model based predictions of "mission performance" are shown in 


Table 6. 
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Although the higher stick rates of the two comparison systems may be 
reduced with higher stick gains, it might be at the expense of higher 
tracking errors. It would then seem fair to state that the candidate 
design exhibits equivalent predicted tracking performance scores. 

The eigenvalues of the three systems are compared in Figure 3, 
along with the "description" of the mode shape from the eigenvectors 
of the systems. All the systems exhibit a relatively fast pitch rate 
(e) pole, with the candidate system's eigenvalue near -16. (1/sec) 
while the others are at -18. and -35. (1/sec), respecti vely. 

Both the rate command and air-to-air systems have a real mode 
dominating angle of attack near -1. (1/sec), and the traditional phugoid 
pair near the origin dominating pitch and speed (or e and u). (The 
air-to-air mode also has three control system roots, one at -3.5 
(1/sec) and two at -1. (l/sec«)) 

In definite contrast to these two systems, the candidate system 
has a single root at the origin associated with velocity perturbations 
u. Then a complex coupled mode is present near -.3+ .4j, that includes 
a significant amount of angle of attack a as well as attitude and 
velocity 0 and u. (The participation of this mode in the angle of 
attack will be clearly evident in the time histories shown later). 
Clearly with a higher frequency and a significant a participation, 
this mode is not a conventional phugoid mode. 

Now, consider the time responses to a step of one stick input 
unit, shown in Figures 4-8. The similarity between the rate command 
and air-to-air systems is evident, both clearly showing pitch rate 
command characteristics in the 8 and e responses, and nearly first 
order (a mode) response in angle of attack. 
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In constrast, we see that the candidate design exhibits charac- 
teristics similar to a lightly damped attitude command system in that 
the attitude response tends to a steady state value. Also note the 
oscillatory response in angle of attack, as mentioned in discussing 
the presence of a coupled (u, e, a) mode. 

In this regard they are neither like the AFTI air-to-air mode 
discussed here, nor the decoupled pitch pointing mode [3] that decouples 
attitude response from flight path response - but rather somewhere 
between these modes. 

It is significant that in further application of this methodology, 
by allowing only pitch-rate and angle of attack feedback (instead of 
a, 0 , and e as in the above cases), the resulting pilot-optimal control 
laws were similar to the rate-command systems presented here. In this 
case (a and 8 feedback only) the e mode, referring to Figure 3, remained 
near -16. (1/sec), but the angle of attack was dominated by a single 
pole at -0.6 (1/sec), and two phugoid roots appeared near the origin. 
Therefore, these eigenvalue locations are very near those in the rate 
command and AFTI air-to-air systems (still referring to Fig. 3). 

Likewise the time responses were similar to these two "rate-command 11 
systems. Additionally, even with feedback of attitude angle not 
included, the tracking error only increased to 0.69 degrees while 
the stick rate increased slightly also to 9.4 deg. /sec. (referring 
to Table 6). Therefore, it would appear that in the absence of 
attitude-angle for feedback, the optimum system dynamics for attitude 
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tracking are like K/s, agreeing with well known results. However, 
if attitude feedback is allowed, significantly different dynamics are 
optimum for this pitch tracking task, but with only slightly improved 
tracking errors, however. 

Another closed-loop analysis method, the Neal-Smith criterion, 
has been proposed to obtain pilot-rating predictions from frequency 
response characteristics of the pilot-aircraft system in pitch tracking 
tasks [11]. In their work, Neal and Smith hypothesized that "pilot 
rating is correlated with the pilot's compensation required to achieve 
good low frequency performance (good tracking) and the pilot/vehicle 
oscillation that resulted". In recent studies by Bacon and Schmidt 
[10], the same approach was considered but with the use of the opti- 
mal control pilot model instead of a describing function modeling 
approach. Using this technique, a relationship was established between 
predicted pilot rating, pilot phase (lead or lag) compensation, and the 

resonance peak of the closed-loop system transfer function, or ||— | 

H c max 

Based on the above, we compare the three configurations of inter- 
est in our research in terms of the Neal-Smith parameters, and results 
are given in Figure 9. Here, the levels of handling qualities are 
defined by 




Figure 9 


Neal-Smith Analysis Results 


ro 

CTs 
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Level 1 = 1.0 - 3.5 Cooper-Harper Scale, good 

Level 2 = 3.5 - 6.5 Cooper-Harper Scale, fair 

Level 3 = 6.5 - 10.0 Cooper-Harper Scale, poor 

From Figure 9, all the configurations fall within the bounds of Level 1 

and therefore they are predicted to attain good handling qualities 
characteristics according to the Neal-Smith criterion. 

V. SUMMARY 

Analytical evaluations have shown a favorable comparison between 
the simple augmentation system obtained and systems obtained using two 
alternate methods. The same level of tracking performance is predicted 
for all the controllers, which are also predicted to be acceptable to 
the pilot in the task considered. It was noted that the augmented 
vehicle dynamics are significantly different, showing the presence of 
nonconventional modes. This leads one to conjecture about the poten- 
tial of significantly different dynamics in future vehicle designs. 

Finally, we note that the procedure resulted in a system that, 
at least for low frequencies, behaved like a pure gain plant (or 
0 ( s )/ 6 s ^ ( s ) ~ K) while the other design approaches (and the proposed 
method, without e feedback) tended to lead to plant characteristics 
more like K/S. Which are ultimately optimum in the variety of tasks 
over the flight envelope for future vehicles are yet to be determined. 
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APPENDIX 

The equations of motion of the aircraft in state variable form 
were given for the flight condition of interest as 


x = Ax'+ Bu 


(A.l) 


with 

X — , C( , 6 s 9 ] s 

U T = [<$£, 6p] 

Assuming the stick input to be proportional to commanded pitch rate, yields 

A • 

< 5=0 
St C 


The commanded signal is modeled then as a first order Markov process 


with: 


t s = .2 sec time constant related to the pilot 
dynamics 

£ = Gaussian random variable with zero mean 

2 

and intensity a ^ 


Augmenting (A.l) with (A. 2), yields 


X 


A 

• 0 


~~ — 
X 


B 


0 

— 


— 



— _ 


— 

u + 


a p 


0 

- 1/T S 


u 

p 


0 


1 

— — 


- 

- 









(A. 2) 
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_* 


The optimal u is chosen such that the following index of per- 
formance is minimized 


J 


E{lim ~ ( [(e-e.)^ + u T Fu dt > 
T-*=o J o c 


F = fl , fa scalar 


According to linear optimal control theory we have 


u* = - i [B T 0] P 


i 51 


_ j = [10, k 2 ] 


i X 


p J 


(A. 4) 


where P is the solution of the algebraic Riccati equation 


A T P + PA + CC T - P 


where 


ijj F -1 [B T 0] P = 0 

I_0J 


[0 -0 C ] = C 


Using (A. 4) the augmented dynamics have the form 

x = (A + BK-j ) x + BK 2 Up 
or 


x \ug x + ^st 5 stick 
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